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M e thod for D e picting an Object Displayed in a Volum e Data S c t SPECIFICATlON 

TITLE 

METHOD FOR DEPICTING AN OBJECT DISPLAYED IN A VOLUME DATA SET 

BACKGROUND 

[00011 The invention concerns a method for representation of a subject 

represented in a volume data set. 

[00021 Images acquired with modern imaging medicine-related apparatuses in 

particular exhibit a relatively high resolution, such that enhanced 3D exposures 
(volume data sets) can be generated with them. Imaging medicine-related 
apparatuses are include , for example, ultrasound, computer tomography, magnetic 
resonance or x-ray apparatuses or PgF Positron Emission Tomography (PET) 
scanners. Furthermore, computer tomography (CT) or x-ray apparatuses can be 
used more often since a radiation exposure that an organism is exposed to during an 
examination with one of these apparatuses has decreased. However, volume data se t s 
contain a larger data quantity than image d ata s e ts o f conv e ntional tw o -d imen s ional i mages . 
which is why an evaluation of volum e d a ta s e t s is r e lati ve l y tim e -c onsum in g . T he actu al 
acquisition of the volume data sets lasts approximat e ly half a minute, in contra s t to wh i ch a 
half h our or more is ofte n ne e d ed to thin out and prepare the volume data set. Automatic 
det e ction and preparation methods are therefore neces s ary and welcom e . 

[0003] However, volume data sets contain a larger data quantity than image 

data sets of conventional two-dimensional images, which is why an evaluation of 
volume data sets is relatively time-consuming. The actual acguisition of the volume 
data sets lasts approximately half a minute, in contrast to which a half-hour or more 
is often needed to thin out and prepare the volume data set. Automatic detection 
and preparation methods are therefore necessary and welcome. 

[00041 Until approximately the year 2000, it was typical (nearly) only in 

computer tomography (CT) to make a diagnosis using axial slice stacks (slice 
images) or to at least orient oneself predominantly on the slice images for a 
diagnosis finding. Thanks to the increased computing capacity of computers, 3D 
representations have expanded to finding consoles since approximately 1995; 
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however, they initially had a more scientific or supplementary importance. In order to 
make a diagnosis easier for a doctor, four basic methods of 3D visualization have 
also been developed: 

r00051 1 . Multiplanar reformatting (MPR): This is nothing other than a 

reconfiguration if the volume data set is_in a different orientation than, for example, 
the original horizontal slices. In particular, differentiation is made between 
orthogonal MPR (3 MPRs, respectively perpendicular to one of the original 
coordinate axes), free MPR (angled slices; derived-^ i.e., interpolated) and curved 
MPR (slice generation parallel to an arbitrary path through the image of the body of 
the organism and, for example, perpendicular to the MPR in which the path was 
plotted). 

[00061 2. Shaded surface display (SSD): Segmenting of the volume data 

set and representation of the surface of the excised objects, most strongly 
characterized by orientation to the grey grav values of the image (for example^ CT 
values) and manual auxiliary editing. 

f00071 3. Maximal intensity projection (MIP): Representation of the 

highest intensity along each ray. Only a partial volume is represented in what is 
known as Thin MIP. 

[00081 4. Volume rendering (VR): What is understood by this This is a 

modeling using rays that penetrate into the subject or exit from the subject 
comparable to x-rays. The entire depth of the imaged body (partially translucent) is 
thereby acquired; however, details of small objects and especially objects shown in a 
thin layer are lost. The representation is manually characterized by adjustment of 
what ar e known as "transfer functions" (color lookup tables). Illumination effects can 
be to be mixed in, in that further storage planes are used in which gradient 
contribution and direction for the illumination are stored and allowed for in the 
representation. 

[00091 However, a disadvantage of the known methods is the insufficient 

representation of relatively fine structures, in particular particularlv when a relatively 
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large volume data set is present. A further disadvantage of the known method is that 
respectively only the entire 3D block is shown in a fixed context. 

SUMMARY 

[00101 It is therefore the object of the invention to specify a an advantageous 

method with which to show relatively fine structures, in particula r particularly structures 
imaged in a relatively large volume data set , ar e shown in an improv e d mann e r . 

[00111 The object of the invention is achieved by a method for representation 

of a subject imaged in a first volume data set, which method comprises the following 
method steps: 

• g e n e ration o f generating a second volume data set in which the 

volume elements of the first volume data set are modulated and/or 
coded, dependent on depth, parallel to the main observation direction 
running in the first volume data set, and 

• application o f applying volume rendering on the second volume 

data set. 

[00121 It is thea goal and the-obiect according to various embodiments of the 

inventive method to achieve a continuous 3D representation through the entire depth 
of the imaged subject via a further development of the volume rendering, without a 
special segmentation of the subject imaged in the first volume data set. The first 
volume data set is, for example, generated with a computer tomograph or a 
magnetic resonance apparatus, in general with an imaging apparatus that is suitable 
for generation of a volume data set. 

[00131 Additionally, a spatial and plastic impression of the imaged subject is 

inventively, simultaneously achieved via a depth shading. For this, the second 
volume data set is inventively produced from the first volume data set, in that 
preferably all volume elements (in CJ X for example^ in Hounsfield units) of the first 
volume data set are depth-dependently modulated o r, r e sp e ctiv e ly, coded and stored 
in the direction of the main observation direction, and the known volume rendering is 
applied to the second volume data set. Volume rendering is, for example, described 
in Foley et al., "Computer Graphics: Principle and Practice-{sie}, 2nd edition, 
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Addison-Wesley, 1990, pages 1034 through 1039. For e xample, on the one hand in the 
sense of a depth shading the plastic 3D impress i on i s thu s improved in coop e ration with what 
is known a s alpha bl e nding. 

[00141 For example, on the one hand, in the sense of a depth shading, the 

plastic 3D impression is thus improved in cooperation with "alpha blending". The 
alpha value determines the transparency or opacity of the represented subjects and 
is defined for each possible value of the volume data. On the other hand, a 
continuous selection possibility results for the respectively shown depth range. This 
is non-trivial since, for example, a broad spectrum of measurement values exists in 
computer tomography. 

r0015l Th e alpha value determines th e transparency or, resp e ctiv e ly, opacity of the 

r e pr e s e nt e d subj e cts and i s d e fin e d for e ach possibl e value of th e volum e data. On the other 
hand, a continuous selection possibility results for the respectively shown depth ran g e. Th i s 
is non trivial since, for example, a b road spectrum of mea sur e m en t valu es e xi sts in computer 
tomography. The imaged subject is, for example, a body of an organism. A specific 
density of contrast agent or bone (spinal column) further back in the imaged body of 
the organism with a strong opaquely-set alpha is always x-rayed towards the front 
with regard to a viewing direction (ray) of an observer when occluding objects along 
the ray extend only to a limited extent and exhibit an alpha that is set less opaque 
(= i.e., transparent). This contradiction cannot be resolved with conventional volume 
rendering. In an occlusion line (along the ray), only one subject can ever actually be 
shown completely clearly and a switch over to the representation of other subjects 
entails effort and significant modification of the image impression. 

[00161 Via depth selection, in particular particularly in real time, embodiments of 

the inventive method now effeps offer the possibility to represent all partial subjects 
(organs) without change of the overall impression, with complete contrast and depth 
shading. So to speak ln a manner of speaking , a further alpha is impressed on the 
volume data set in the main observation direction with a different inertia /energy than 
the exponential decay of the alpha blending and adjusted to the preservation of the 
density modulation in the first volume data set (in CT, for example,, in Hounsfield 
units). This is applied such that a depth shading (thus a shadow formation at the 
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edges from the front to the back) results locally on the imaged partial subjects, 
wh e r e by where all partial subjects appear plastic. 

f00171 For example, with a sliding control- k, the depth range to be shown can 

be continuously adjusted which d e pth range should be shown, wh e r e by , where the sliding 
control acts on a sub-range of the transfer function that is shifted on the value scale 
of the modulated o r, respectively, coded volume data set. It is th e r e by nov e l 
that Advantageouslv, the updating of the representation can in particula r particularly 
ensue in real time because the volume data are already stored beforehand in the 
suitable modulation o r, r e spectiv e ly, coding, for cxampl e e.g.. in a display storage, for 
example^ of a conventional graphic card. This adjustment is also comparable with 
the adjustment of the depth of field in photography. However, in contrast to the 
photographic depth of field, here the possibility exists to define the front and rear 
edge significantly more precisely, for example^ with a rectangular transfer function, 
which is primarily important to the observer in order to completely fade out viewing 
obstacles. 

[00181 The corresponding design of the transfer function involves, in the 

simplest case (for example) ramp functions falling off to the rear with regard to the 
observer when a depth shading from the front to the back is desired or (as it is 
provided according to an embodiment of the invention) in the form of a modified 
rectangle or bar whose canted upper edge falls off to the rear, the coded or 
modulated storage of the volume in the form of the second volume data set in the 
storage. 

[00191 The corr e s p o n din g de si gn o f th e transf e r functio n ? in the s i mpl est case (fo r 

e xampl e ) ramp functions fall ing off to th e r e ar with regard to the observer wh e n a d e pth 
shading from the front to the back is desired or (as it is provid e d according to an e mbodiment 
of the invention) in the form of a modifi e d r e ctangle or bar whose canted upp e r edge falls off 
to th e r e ar, involves th e coded or, r e spectiv e ly, modulat e d storag e of th e volume in the form 
of th e s e cond volum e data s e t in the storag e . According to a variant A ccording to an 
embodiment of the inventive method, the transfer function is stored in a lookup table. 
Instead of a slide control, a mouse [sic] or other controller, the depth adjustment can 
also be implemented by m e ans wav of a navigation system as it is provided according 
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to a further va r iant embodiment of the inventive method. In this case, both the 
viewpoint and the perspective (as in conventional volume rendering) and the 
selection of the current volume data to be represented in real time are set by the 
navigation system. This enables a "fly through" through all volume data of an 
inherently closed, imaged subject. Previously known methods allow this only via 
selection in the data (MlP-only maximum values, but over the entire volume), via 
selection of a special path through hollow spaces connected with pre-segmentation 
(actual fly-through) or via elaborate pre-calculations (segmentation, coloring, actually 
another data selection). 

f00201 A further improvement of the representation of the imaged subject, 

most of all at primarily the speed of the representation, is achieved according to 
embodiments of the inventive method when what it known as a "texture mapping" is 
additionally implemented ( in particiila r particularlv according to the shear warp 
method), the volume elements of the first and/or second volume data set are 
interpolated, the first and/or second volume data set are filtered and/or the result of 
the filtering of the first volume data set and/or the result of the filtering of the second 
volume data set are buffered. 

DESCRIPTION OF THE DRAWINGS 

An exemplary embodiment of the invention is ex e mplarily shown in the 
accompanying schematic drawings. Th e r e by shown ar e : 

Figure 1 is an isometric / pictorial schematic drawing of a computer 
tomography 

Figure 2 is a three-dimensional pictorial illustration of a first volume data 
set with a virtual ray, acquired with the computer tomography 

Figure 3 is a three-dimensional pictorial illustration of a further volume 

data set produced from the volume data set shown in Figure 3^2; 

Figure 4 is_a graphical representation of a transfer function; and 

Figure 5 ais an image representation produced by m e ans wav of the 
inventive method. 


6 Mark Up Substitute Specification 


DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[00211 Figure 1 schematically shows a computer tomograph with an x-ray 

source 1 from which a pyramidal x-ray beam 2 emanates whose edge rays are 
shown in a dash dot mann e r as dashed lines in Figure Kwhich l. The x-ray beam 2 
penetrates an examination subject (for example A a patient 3) and impinges on a 
radiation detector 4. In the case of the present exemplary embodiment, the x-ray 
source 1 and the radiation detector 4 are arranged opposite one another on an 
annular gantry 5. The gantry 5 is borne on a mounting device (not shown in Figure 
1 ) such that it can rotate with regard to a system axis 6 which runs through the 
center point of the annular gantry 6 ( compare in a direction indicated by arrow a). 

1*00221 In the case of the present exemplary embodiment, the patient 3 lies on 

a table 7 transparent to x-radiationT^whiek . This table 7 is borne by m e ans of a carrier 
device (likewise not shown in Figure 1 ) such that sakithis table 7 can shift along the 
system axis 6 ( compare in a direction indicated by arrow b). 

[00231 The x-ray source 1 and the radiation detector 4 thus form a 

measurement system that is rotatable relative to the system axis 6 and can shift 
relative to the patient 3 along the system axis 6 such that the patient 3 can be 
irradiated from different projection angles and various positions with regard to the 
system axis 6. From the output s ignals of O nce the radiation detector 4 th e r e by 
occurring produces the output signals , a data acquisition system 9 forms 
measurement values that are supplied to a computer 1 1 that ( by m e ans o f via known 
methods known to th e averag e man s kill e d in the art ) calculates an image of the patient 
3 that can in turn be reproduced on a monitor 12 connected with the computer 11. In 
the case of the present exemplary embodiment, the data acquisition system 9 is 
connected wkhto the radiation detector 4 with an electrical line 8 that (in a manner 
not shown), for example, comprises a slip ring system or a wireless transmission 
path and wi#*to the computer 1 1 with an electrical line 10. 

f00241 The computer tomograph shown in Figure 1 can be used both for 

sequence scanning and for spiral scanning. 
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[00251 In the sequence scanning,, a slice-by-slice scanning of the patient 3 

ensues. The x-ray source 1 and the radiation detector 4 is [sic] ther e bv are rotated 
around the patient 3 with regard to the system axis 6 and the measurement system 
comprising the x-ray source 1 and the radiation detector 4 acquires a plurality of 
projections in order to scan a two-dimensional slice of the patient 3. A slice image 
representing the scanned slice is reconstructed from the measurement values 
thereby acquired. The patient 3 is respectively moved along the system axis 6 
between the scanning of successive slices. This event is repeated until all slices of 
interest are acquired. 

[00261 During the spiral scan, the x-ray source 1 and the measurement 

system comprising radiation detector 4 mov e s rsicl move continuously in the direction 
of the arrow b relative to the system axis 6 and the table 7, i.e. the measurement 
system comprising the x-ray source 1 and the radiation detector 4 move continuously 
on a spiral path c relative to the patient 3 until the region of interest of the patient 3 is 
completely acquired. AThis generates a volume data set is thereby gen e rat e d that, in 
the case of the present exemplary embodiment, is coded according to the DICOM 
standard typical in medical technology. 

[00271 In the case of the present exemplary embodiment, a volume data set 

(comprised of a plurality of successive slice images) of the abdominal region of the 
patient 3 is created with the computer tomograph shown in Figure 1 with 
approximately 500 CT slices (slice images) of the matrix 512x512. 

[00281 The volume data set is, for example, interpreted as slices parallel to the 

table 7 for the application in minimally-invasive surgery/laparoscopy. The slice 
orientation (coronary) is approximately at a right angle to the viewing direction of a 
doctor (not shown in Figure 1) who normally views approximately perpendicular to 
the abdominal wall of the patient 3. 

[00291 The volume data set i s , for e xampl e , interpr e ted as slices parall e l to th e tabl e 7 

for the application in minimally invasive surg e ry/laparoscopy. The s lice orientation 
(coronary) is ther e by approximat e ly at a right angl e to the v ie w i ng dir ec tion of a doctor (not 
shown in Figure 1 ) who normally views approximat e ly perpendicular to the abdominal wall 
of the patient 3. In the case of the present exemplary embodiment, these slices are 
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interpreted as textures or interpolated multi-textures and accounted for [sic] into in a 
3D representation according to the shear warp method (a_known characteristic of 
volume rendering). The volume data set 20 created from this is schematically shown 
in Figure 2. A virtual ray 21 emanating in approximately the viewing direction of the 
doctor and running into the volume data set 20 is shown as a dashed line in Figure 
2. That coordinate axis of the original volume data set which, in the preferred 
observation direction of the operator, has the smallest angle relative to the ray 21 
( and thus runs elesesclosest to parallel to the ray 21 in the preferred direction) is 
designated as a main observation direction 22. The specified method functions 
r e lativ e ly well with this on e pr e ferred direction for larg e data s e ts, as in this e xampl e , and 
also for d e fl ect i o ns of the viewing directi o n up to approximately + - 80° to th e sid e s or 
up/down. For an improved representation, one redirects to + 4 5°, for e xample to slic e s th a t 
s tand perp endic ular t o the first orientation (axial or sagittal). In prin cipl e , in the case of the 
pr e ferred exemplary embodiment the 3D data ar e stor e d exclusiv e ly for the color lookup 
mode including black and whit e repres e ntation. On the on e hand, for r e latively large data 
sets this means a minimal storage requirement (for example 8 bit in 3D, for exampl e 32 bit 
only for th e display); on th e oth e r hand this means th e possibility that th e repr e sentation can 
b e modified or, r e spectiv e ly, 

100301 The specified method functions relatively well with this one preferred 

direction for large data sets, as in this example, and also for deflections of the 
viewing direction up to approximately +A 80° to the sides or up/down. For an 
improved representation, one redirects to +/- 45°, for example, to slices that stand 
perpendicular to the first orientation (axial or sagittal). 

K)0311 In principle, in the case of the preferred exemplary embodiment, the 3D 

data are stored exclusively for a color lookup mode including black-and-white 
representation. On the one hand, for relatively large data sets, this means a minimal 
storage reguirement (for example, 8-bit in 3D, for example, 32-bit only for the 
display); on the other hand, this means the possibility that the representation can be 
modified or adapted via modification of the lookup table in real time. 

[00321 A connection of the representation control with shading and depth 

information is now inventively provided via a lookup table. For this, in the case of the 
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present exemplary embodiments a further volume data set 30 (shown in Figure 3) is 
produced in which the volume elements 23 of the volume data set are modulated per 
voxel with a depth value along the edge-parallel main observation direction as well 
as possibly with further filter responses and, coded via this one-time pre-processing, 
are stored in the working storage of the grapkie graphics card 1 3 of the computer 1 1 . 

[00331 In the case of the present exemplary embodiment, the modulation of 

the individual volume elements 23 of the volume data set 20 occurs along the main 
observation direction 22, and in fact such that the grey grav values (for example^ 
Hounsfield units in CT) of the volume elements 23 of the volume data set 20, which 
are further removed from the viewpoint of an observer along main observation 
direction 2, are accounted for with a smaller factor than the grey gray values of the 
volume elements 23 that are located closer to the observer. 

f00341 The further volume data set 30 is subsequently accounted for in real 

time in the representation with an alpha value possibly modified relative to the other 
volume rendering and shown under cooperation cooperating with a lookup table 
(transfer function). 

[00351 In the case of the present exemplary embodiment, the transfer function 

has the form of a canted bar 40, as this4s-schematically shown in Figure 4. The 
coding in the volume data set 30 and the application of the transfer function ensues 
{sie]-such that the displacement range of the canted bar 40 corresponds to the depth 
of the volume data set 30, and therewith the entire color o r, respectively, gr e y gray 
value range (in 8-bit, for example A 256 elements in size) of the volume elements of 
the data set 30 can be imaged. The depth of the further volume data set 30 is 
shown with an axis 31 . 

[00361 ' n the real-time generation of the 3D view, each of the coded slices 

(textures) of the further volume data set 30 is distorted as it corresponds to the 
current perspective view with central ray 21 and then ultimately added into an 
accumulator texture after multiplication with the cited blending alpha. In the case of 
the present exemplary embodiment, a real-time interpolation is also used in the 
gaphie graphics card 13. 
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[00371 The accumulator storage '(for example^ a display buffer) in the 

gfap&e qraphics card 13 contains a shaded, if applicable A edge-emphasized 3D 
image with the same coding and accounting, in which are shown one or more depth 
ranges of the original volume data set 20 shown in Figure 2. The sensing of the 
desired depth ensues via the corresponding setting of the lookup table. A refined, 
also non-linear coding can be effected in order to, for example, more clearly 
separate or fade out uninteresting structures such as , for e xample, (in most cases) 
bones (ribs). Such a special coding should be oriented to the conditions of the scale 
of the measurement values, in the case of the present exemplary embodiment the 
Hounsfield units of the individual volume elements of the volume data set 20. 

[00381 For example, the values of the lookup table (transfer function) appear 

so: the canted rectangle extends into the depth range of approximately 136 mm to 
120 mm, corresponding to positions 136 through 120 for the lookup function. Given 
pure gre yqray -value coding, the display color value "255, 255, 255" stands in position 
136, decreasing, for example, to the value "50, 50, 50" at position 120. This is 
amplified by the depth coding in the volume data set 30, in that, for example, in a 
lateral plan view of a subject surface, surface volume elements lying further to the 
rear are rendered transparently darker in the alpha integration than volumes volume 
elements lying further towards the front, and the plastic o r, resp e ctively, the amplified 
spatial effect results from this. 

[00391 The overall accountings are, for example, activated by a shift control or 

a mouse movement or ensue continuously via updates of the position and orientation 
coordinates of a navigation system (not shown in detail in Figure 4-1, but generally 
known to the average man skill e d in th e ait ), such that approximately 15 renderings per 
second are achieved, for example^ with standard graphie graphics cards obtainable at 
present. 

[00401 A representation produced with the inventive method is exemplarily 

shown in Figure 5 in the form of an image 50. 

[00411 In the case of the present exemplary embodiment, the volume data set 

20 is produced with a computer tomograph and exists in the form of a plurality of 
successive computer-tomographic slice images. The volume data set 20 can, 
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however, also be produced with other imaging apparatuses such as, in particular, a 
magnetic resonance apparatus, an x-ray apparatus, a ultrasound apparatus or a 
PET scanner. The volume data set 20 also does not have to exist in the form of a 
plurality of successive computer-tomographic slice images. 

[00421 The inventive method can also be used for imaged technical subjects. 

[00431 The exemplary embodiment likewise has only exemplary character. 

[00441 For the purposes of promoting an understanding of the principles of the 

invention, reference has been made to the preferred embodiments illustrated in the 
drawings, and specific language has been used to describe these embodiments. 
However, no limitation of the scope of the invention is intended by this specific 
language, and the invention should be construed to encompass all embodiments that 
would normally occur to one of ordinary skill in the art. 

[00451 The present invention may be described in terms of functional block 

components and various processing steps. Such functional blocks may be realized 
bv any number of hardware and/or software components configured to perform the 
specified functions. For example, the present invention may employ various 
integrated circuit components, e.g., memory elements, processing elements, logic 
elements, look-up tables, and the like, which may carry out a variety of functions 
under the control of one or more microprocessors or other control devices. Similarly, 
where the elements of the present invention are implemented using software 
programming or software elements the invention may be implemented with any 
programming or scripting language such as C, C++, Java, assembler, or the like, 
with the various algorithms being implemented with any combination of data 
structures, objects, processes, routines or other programming elements. 
Furthermore, the present invention could employ any number of conventional 
technigues for electronics configuration, signal processing and/or control, data 
processing and the like. 

[00461 The particular implementations shown and described herein are 

illustrative examples of the invention and are not intended to otherwise limit the 
scope of the invention in any way. For the sake of brevity, conventional electronics, 
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control systems, software development and other functional aspects of the systems 
(and components of the individual operating components of the systems) may not be 
described in detail. Furthermore, the connecting lines, or connectors shown in the 
various figures presented are intended to represent exemplary functional 
relationships and/or physical or logical couplings between the various elements. It 
should be noted that many alternative or additional functional relationships, physical 
connections or logical connections may be present in a practical device. Moreover, 
no item or component is essential to the practice of the invention unless the element 
is specifically described as "essentiar or "critical". Numerous modifications and 
adaptations will be readily apparent to those skilled in this art without departing from 
the spirit and scope of the present invention. 
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AbstoetABSTRACT 


The invention r e lates to aA method is provided for depicting an object (3) 
displayed in a first volume data set-(2©). A second volume data set-(30) is firstly 
produced by modulating, according to depth, the volume elements (33)-of the first 
volume data set (20)-along a main viewing direction (33)-that passes into the first 
volume data set-(30). Afterwards, the second volume data set (30}-undergoes a 
volume rendering. 
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